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Abstract. This study examines the effects of the pedagogical use of an interactive 
mobile digital game, Pret a Negocier (PaN), on improving learners’ pronunciation 
of French as a Second Language (FSL), using three holistic measures: 
comprehensibility, fluency, and overall pronunciation. Two groups of FSL learners 
engaged in different types of game-playing over one month: while the experimental 
group played PaN, the control group engaged in paper-based gamified information 
gap activities. Following a pre-test/post-test research design, our findings revealed 
no statistically significant differences between the two groups. 

Keywords: digital gaming, L2 pronunciation, French. 


1. Introduction 

Second/foreign language (L2) pronunciation is often evaluated based on at 
least three criteria (e.g. Derwing, Rossiter, Munro, & Thomson, 2004): users’ 
intelligibility (the extent to which non-native speech can be understood by others), 
comprehensibility (the listener’s perceptions of how difficult to understand the 
speech is), and fluency (one’s ability to speak in an efficient, effortless manner). 
In L2 pedagogy, one of the key recommendations for developing pronunciation 
is practice, preferably involving repetition and the recycling of already-acquired 
features (Nation & Newton, 2009), in an interactive environment (Zielinski, 2012). 
However, because of time constraints, these goals are not easily achievable. One 
way to fulfill these recommendations and circumvent time constraints is via the use 
of tools that promotes interaction among interlocutors, motivates learners to reuse 
their linguistic skills, and allows them to practice on their own in a meaningful, fun 
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environment. We believe that PaN (developed by Avery Rueb, Walcir Cardoso, and 
Affordance Studio - http://app.readytonegotiate.com) fulfills these criteria. 

PaN is a digital information gap activity designed to help French students develop 
their oral interaction skills. It can be played on mobile and static devices, both in 
face-to-face interactions in the classroom or at home via chat. To succeed in game¬ 
playing, students are required to exchange information about a product to buy/ 
sell (e.g. a cell phone), and negotiate with a partner to arrive at a final price within 
a three minute time frame. Figure 1 illustrates the seller’s version of the game’s 
interface in English. 

Figure 1. PaN interface 



Our goal was to examine the effects of the pedagogical use of PaN on improving 
French learners’ pronunciation, which we hypothesised to positively impact 
its development (see Hwang et al., 2016 for the rationale, in the context of L2 
speaking). Accordingly, the study was guided by the following question: Can PaN 
help French learners improve their pronunciation on three measures of oral ability 
- comprehensibility, fluency, and overall pronunciation? 


2. Method 

The participants were 40 students (average age: 20) enrolled in an intermediate- 
level FSL class in a pre-university institution (cegep) in Quebec, Canada. The goal 
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of the course was to develop French language skills to prepare beginner students 
for more advanced courses. 

The participants were stratified into two groups: while the experimental group 
(n=22) played PaN, the control group (n=12) engaged in paper-based gamified 
information gap activities (e.g. Perfect Partner, where students moved around 
the classroom asking questions to find students with similar information on their 
card, under time constraints to emulate most features of PaN). These game¬ 
playing sessions lasted approximately 25 minutes each, and were conducted 
biweekly over a period of four weeks, for a total of approximately 200 minutes 
of gameplay. 

The study followed a pre-/post-/delayed post-test design and measured the 
participants’ improvement in French pronunciation in three dimensions, as 
assessed by 16 judges: comprehensibility, fluency, and overall pronunciation 
abilities (an impressionistic evaluation of speech combining segmental and 
prosodic features such as stress, rhythm, and intonation). 

The judges were asked to rate ten second randomised excerpts of speech by 
participants performing a picture-narrative task based on the “Suitcase Story” 
(Derwing et al., 2004), over the three testing phases. After listening to each 
excerpt, the judges were asked to indicate, on a six item Likert scale, how they 
rated that participant’s pronunciation based on the three dimensions adopted. 


3. Results 

Based on a six point Likert scale, judges’ ratings for comprehensibility, fluency, 
and overall pronunciation abilities were examined at the pre-, post-, and delayed 
post-tests (see Table 1 for means and standard deviations). 

As the data are non-parametric, a Wilcoxon Signed-Rank test was conducted based 
on a student’s mean rater score for each of the three measures between two given 
tests. A summary of the findings is provided below: 

• For comprehensibility, the treatment group showed no significant 
difference between pre- and post-tests (Z=-l .39, p=0. 16). nor between the 
pre- to delayed post-tests (Z=-0.73,/?=0.17). Similarly, the control group 
showed no improvement between pre- and post-tests (Z=-0.311, j?=0.76), 
nor between the pre- to delayed post-tests (Z—0.47, p=0.64). 
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• For fluency, the treatment group showed no significance between pre- and 
post-tests (Z=-1.92, p=0.055), nor pre- and delayed post-tests (Z—1.48, 
p= 0.14). The control group also showed no improvement between pre- 
and post-tests (Z—0.59, j?=0.56), nor between the pre- to delayed post¬ 
tests (Z=-0.24,/>=0.81). 

• For overall pronunciation abilities, again we see no significance for the 
treatment group between pre- and post-tests (Z=-0.98, j?=0.33), nor pre- 
and delayed post-tests (Z—1.37 p=0. 17). The control group also showed 
no improvement between pre- and post-tests (Z=-1.10, p= 0.27), nor 
between the pre- to delayed post-tests (Z=-1.03, y?=0.30). 


Table 1. Judges’ratings 




Pre-test 

Post-test 

Delayed 

post-test 

Measure 

Group 

M 

SD 

M 

SD 

M 

SD 

Comprehensibility 

Treatment 

2.85 

0.92 

3.25 

0.91 

3.08 

1.00 

Control 

2.98 

0.83 

3.10 

1.13 

2.82 

0.81 

Fluency 

Treatment 

2.18 

0.65 

2.55 

0.88 

2.53 

0.93 

Control 

2.33 

0.74 

2.45 

0.91 

2.41 

0.61 

Pronunciation 

Treatment 

2.27 

0.66 

2.50 

0.76 

2.59 

0.80 

Control 

2.41 

0.60 

2.60 

0.86 

2.29 

0.65 


Mann-Whitney U tests were also conducted to compare improvement between 
groups for each measure in each test. Results (displayed in Table 2) indicate no 
significant difference. 


Table 2. Mann-Whitney U between-groups comparison 



Pre-test 

Post-test 

Delayed 

post-test 

Measure 

U 

p-value 

U 

p-value 

U 

p-value 

Comprehensibility 

127.00 

0.86 

125.50 

0.82 

111.00 

0.45 

Fluency 

117.00 

0.59 

131.50 

0.99 

127.00 

0.86 

Pronunciation 

120.50 

0.68 

113.00 

0.49 

108.50 

0.40 


In summary, despite a trend toward significance found for fluency between pre- 
and post-tests (/;=.055), these results show that game-playing had no effect on 
improving the participants’ overall pronunciation, considering the three measures 
employed in the study: comprehensibility, fluency, and overall pronunciation 
abilities. 
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4. Discussion and conclusions 

We hypothesised that the motivation and ‘forced output’ engendered by 
interactive games such as PaN would encourage learners to practice language 
and, via systematic repetition (Nation & Newton, 2009) and negotiation with their 
interlocutors (Swain & Lapkin, 1995), improve their L2 linguistic knowledge, 
particularly in terms of fluency - the use of language in an efficient, effortless 
manner. However, the results of the three pronunciation tests adopted to assess L2 
pronunciation skills suggested that, based on listeners’ perceptions, game-playing 
had no effect on the improvement of FSL learners’ pronunciation, despite a trend 
towards significance for oral fluency. It is possible that these results are due to the 
brevity of the one month treatment, which seems insufficient for the development 
of the three aspects of pronunciation in this study. Focusing on fluency, the non¬ 
significance observed might be due to the nature of the impressionistic measures 
adopted, based merely on judges’ ratings. 

In future studies, we aim to triangulate the analysis by incorporating other 
quantitative measures to assess L2 pronunciation development, including 
temporal measures, such as rate of speech and pause length. It is also possible 
that the information gap activity model used for both experimental and control 
groups was equally effective (though not statistically significant), with the digital 
component having little effect on the outcomes. Indeed, the trend in increased 
fluency for the experimental group suggests that digital game-playing placed 
more pressure on students to speak faster than its paper-based counterpart, as 
having an on-screen countdown may be more effective than watching a wall 
clock. 

Despite the lack of significance for L2 pronunciation, based on a previous study 
(Rueb, Cardoso, & Grimshaw, 2016), we believe that PaN has the potential of 
enhancing the learning of FSL, at least in areas such as vocabulary acquisition 
(forthcoming research), the development of negotiation skills in speaking and 
listening, and the overall learning experience in a fun, gamified environment that 
can take place whenever and wherever learners feel pret a negocier. 


References 


Derwing, T., Rossiter, M., Munro, M., & Thomson, R. (2004). Second language fluency: 
Judgments on different tasks. Language Learning, 54(A), 655-679. https://doi.org/10.llll/ 
j. 1467-9922.2004.00282.x 


71 




Walcir Cardoso, Avery Rueb, and Jennica Grimshaw 


Hwang, W.-Y., Timothy, K., Ma, Z.-H., Shadiev, R., & Chen, S.-Y. (2016). Evaluating listening 
and speaking skills in a mobile game-based learning environment with situational contexts. 
Computer Assisted Language Learning, 29(4), 639-657. https://doi.org/10.1080/09588221. 
2015.1016438 

Nation, I., & Newton, J. (2009). Teaching ESL/EFL listening and speaking. Routledge. 

Rueb, A., Cardoso, W., & Grimshaw, J. (2016). Developing oral interaction skills with a digital 
information gap activity game. In S. Papadima-Sophocleous, L. Bradley & S. Thouesny 
(Eds), CALL communities and culture - short papers from EUROCALL 2016 (pp. 397-402). 
Research-publishing.net. https://doi.org/10.14705/rpnet.2016.eurocall2016.595 
Swain, M., & Lapkin, S. (1995). Problems in output and the cognitive processes they generate: a 
step towards second language learning. Applied Linguistics, 16, 371-391. 

Zielinski, B. (2012). The social impact of pronunciation difficulties: confidence and willingness 
to speak. In J. Levis & K. LeVelle (Eds), Proceedings of the 3rd pronunciation in second 
language learning and teaching conference (pp. 18-26). Iowa State University. 


72 





search-publishing.net 


Published by Research-publishing.net, not-for-profit association 
Contact: info@research-publishing.net 

© 2017 by Editors (collective work) 

© 2017 by Authors (individual work) 

CALL in a climate of change: adapting to turbulent global conditions - short papers from EUROCALL 2017 
Edited by Kate Borthwick, Linda Bradley, and Sylvie Thouesny 

Rights: This volume is published under the Attribution-NonCommercial-NoDerivatives International (CC BY-NC-ND) 
licence; individual articles may have a different licence. Under the CC BY-NC-ND licence, the volume is freely available 
online (https://doi.org/10.14705/rpnet.2017.eurocall2017.9782490057047) for anybody to read, download, copy, and 
redistribute provided that the author(s), editorial team, and publisher are properly cited. Commercial use and derivative 
works are, however, not permitted. 

Disclaimer: Research-publishing.net does not take any responsibility for the content of the pages written by the authors 
of this book. The authors have recognised that the work described was not published before, or that it was not under 
consideration for publication elsewhere. While the information in this book are believed to be true and accurate on the date of 
its going to press, neither the editorial team, nor the publisher can accept any legal responsibility for any errors or omissions 
that may be made. The publisher makes no warranty, expressed or implied, with respect to the material contained herein. 
While Research-publishing.net is committed to publishing works of integrity, the words are the authors’ alone. 

Trademark notice: product or corporate names may be trademarks or registered trademarks, and are used only for 
identification and explanation without intent to infringe. 

Copyrighted material: every effort has been made by the editorial team to trace copyright holders and to obtain their 
permission for the use of copyrighted material in this book. In the event of errors or omissions, please notify the publisher of 
any corrections that will need to be incorporated in future editions of this book. 

Typeset by Research-publishing.net 

Cover design based on © Josef Brett’s, Multimedia Developer, Digital Learning, http://www.eurocall2017.uk/, reproduced 
with kind permissions from the copyright holder. 

Cover layout by © Raphael Savina (raphael@savina.net) 

Photo “frog” on cover by © Raphael Savina (raphael@savina.net) 

Fonts used are licensed under a SIL Open Font License 

ISBN 13: 978-2-490057-04-7 (Ebook, PDF, colour) 

ISBN 13: 978-2-490057-05-4 (Ebook, EPUB, colour) 

ISBN13: 978-2-490057-03-0 (Paperback - Print on demand, black and white) 

Print on demand technology is a high-quality, innovative and ecological printing method; with which the book is never ‘out 
of stock’ or ‘out of print’. 

British Library Cataloguing-in-Publication Data. 

A cataloguing record for this book is available from the British Library. 

Legal deposit: Bibliotheque Nationale de France - Depot legal: decembre 2017. 



